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ABSTRACT 

Nowadays, it is essential for institutions of higher education to enhance the 
continuance commitment of users toward e-learning programs to promote and 
ensure the sustainability of those programs over time. The aim of this research is 
to identify the factors that might contribute to deepening user commitment toward 
e-learning systems from key agents’ perspectives (students and teachers). 
Information was collected from 146 students and 124 teachers participating in e- 
learning programs in higher education. The results showed that perceived 
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organizational impact is the most important antecedent of continuance 
commitment. System quality had the highest impact on perceptions of 
organizational impact among both groups of users.The study showed the need 
for reconsideration of the role of instructor and system quality in the new 
educational paradigm, since both variables had no significant direct effect on the 
continuance commitment of users. This research shows managerial 
recommendations and directions for deepening commitment toward e-learning 
systems. 
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RESUMEN 

Actualmente es esencial para las instituciones de educacion superior fomentar 
un compromiso duradero de los usuarios hacia los programas de ensenanza 
online para promover y asegurar su sostenibilidad en el tiempo. El objetivo de 
este trabajo es identificar los factores que contribuyen a reforzar al compromiso 
del usuario con los sistemas de ensenanza online desde la perspectiva de los 
agentes implicados (estudiantes y profesores). Se recogio informacién de 146 
estudiantes y 124 profesores que participan en programas universitarios de 
ensenanza online. Los resultados indican que el impacto organizacional 
percibido es el determinante mas importante del compromiso temporal. La 
calidad del sistema muestra una gran influencia en las percepciones de 
compromiso organizacional en ambos grupos de usuarios. El estudio muestra la 
necesidad de reconsiderar el rol del profesor y de la calidad del sistema en este 
nuevo tipo de ensenanza, dado que ambas variables no muestran un efecto 
directo significativo en el compromiso temporal de los usuarios. Esta 
investigacion permite derivar recomendaciones para la gestién y direcciones 
para generar compromiso hacia los sistemas de ensenanza online. 


PALABRAS CLAVE 


ensenanza online; compromiso; educacion superior; profesores; estudiantes 


INTRODUCTION 


Extraordinary technological advances have introduced critical change in the 
field of education: from the very first distance courses when voice recordings 
were mailed to a student’s home, and educational programs broadcast at certain 
times on the radio and TV, to the most modern e-learning courses based on 
electronic Learning Management Systems (LMS) (online) (Jamlan, 2004; Muller, 
2015). 

Even working methodologies and _ interpersonal communications are 
experiencing change, as a consequence of electronic channels of communication 
and digital networks (Dyson, Vickers, Turtle, Cowan, & Tassone, 2015). Several 
institutions of higher education have included this technological development to 
improve their student’s learning experience and to fit in with political, economic, 
and institutional requirements (Bartolomé and Aiello, 2006). Intra-institutional 
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initiatives have also encouraged the implementation of more complex LMS, 
although at the beginning there was some reticence among teachers, due to their 
unfamiliarity with e-learning techniques (Barajas, 2002). Internet, electronic 
devices, and online communities have changed the organization and promotion 
of education programs and have created formerly unthinkable learning 
opportunities. These particular initiatives have provoked changes in technology 
and its application in higher educational institutions, the dynamics of their 
organizational structures, and even the educational paradigm (Duart and 
Mengual-Andrés, 2015; Jamlan, 2004; Moreira, 2012). 

E-learning has transformed the situation and created a new model to access 
higher education programs. With the use of specific LMS greater importance is 
attached to the personalization of the e-learning process, because formal and 
informal educational processes happen at the same time over electronic 
channels. Moreover, students and teachers develop tasks (anywhere and 
anytime), analyze and co-create information through electronic devices and 
systems (experiential e-learning), and employ new channels through which to 
communicate and to interact with their targets (social networking). 

There is an extensive amount of research on user perceptions of e-learning 
platforms, but most studies have focused on a single perspective, the perspective 
of either the student or the teacher. On the one hand, student perceptions have 
attracted attention in the past (El-Zeftawy and Hassan, 2016; Lee, Yoon, & Lee, 
2009; Sun, Tsai, Finger, Chen, & Yeh, 2008). On the other hand, although with 
marginal attention, some other studies have explored the perceptions of teachers 
(Jamlan, 2004; Yuen and Ma, 2008). By combining both approaches, this 
research seeks to analyze the perceptions of both students and teachers as the 
key actors in the e-learning system. A dual perception that has rarely been 
explored in the previous literature (Navas, 2016; San Nicolas, Vargas, & Moreira, 
2013). Thus, the objective of the study is to identify the factors of e-learning 
systems that would contribute to enlarging user commitment toward this system 
from both perspectives (students and teachers). 

The structure of this article will be as follows: the next section will contain a 
brief review of e-learning in the context of higher education. The third section will 
be dedicated to explaining the proposed hypotheses. The fourth section will 
describe the methodology and will present the results, and the discussion in the 
last section will lead on to the main conclusions. 


E-LEARNING IN THE CONTEXT OF HIGHER EDUCATION 


There is a consensus among scholars over the need to combine technological 
progress with learning models of proven utility to each educational community 
and society (Barajas, 2002; Duart and Mengual-Andrés, 2015). E-learning 
success often depends on the implementation of a pedagogical model that is 
focused on matching the objectives and the necessities of both students and 
teachers (Bartolomé and Aiello, 2006; Lee, et al., 2009), rather than seeking to 
cultivate other institutional interests. It is therefore essential for the institution to 
maintain its educational quality regardless of the teaching modality (Parahoo, 
Santally, Rajabalee, & Harvey, 2016; Rodriguez, 2013). 

Nevertheless, there is a certain techno-centrist tendency in the implementation 
of these programs, because the technical quality is often perceived as the only 
tool that would enhance the educational features of the program (Navas, 2016), 
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often denying the importance of the pedagogical adaptations needed for this 
educational electronic modality (Bartolomé and Aiello, 2006). Hence, some 
researchers have called for critical reflection that can address this gap and 
identify all the positive and the negative consequences of e-learning adaptation 
in systems of higher education (Hara and Kling, 2001). 

There are some generally perceived advantages with regard to the 
implementation of e-learning programs in higher education (Moreira, 2012): (1) It 
facilitates access to the information. (2) It creates a collaborative relationship 
between students and teachers that is no longer limited by time and space. (38) It 
helps to offer personalized attention and promotes student autonomy, essential 
in the development of their confidence and self-efficacy in a future workspace 
(Henri, Morrell, & Scott, 2018). Moreover, (4) it offers a range of tools that enable 
synchronic and asynchronous channels of communication between participants 
in higher educational systems. 

The theories that set out a path toward the comprehension of e-learning at 
higher education institutions have sought to explain the adoption of user 
technology in the first place, addressing barriers and drivers of e-learning, such 
as the Technology Acceptance Model (TAM), the Unified Theory of Acceptance 
and Use of Technology (UTAUT) and the Information System Success Model 
(ISSM) (Mohammadi, 2015). Other theoretical approaches, such as the 
Information Systems Continuance Model (ISCM), focus on predicting individual 
continuance with e-learning systems as proposed by Bhattacherjee (2001). This 
ISCM framework, also called the “post-adoption model”, informs us that the initial 
adoption of an Information System (IS) is not sufficient to guarantee continuance 
with an e-learning system in the future. The only parameter that will affirm the 
success of an e-learning system is its continuance use (Kang and Lee, 2010). 
The same theory, originally employed in consumer behavior literature, has been 
embraced by e-learning researchers (Ifinedo, 2017; Lin, 2012; Udo, Bagchi, & 
Kirs, 2011), to highlight the need to study which factors incite the commitment of 
participants toward innovative educational models. 

This study contributes to the previous literature by proposing a model for 
empirically testing the effects of four different characteristics (instructor quality, 
system quality, institutional support, and organizational impact) of an e-learning 
system on continuance commitment from the perspective of both students and 
teachers. The proposed model represents an extended version of the ISSM and 
was developed by identifying the key variables from the previous literature 
relating to commitment in the field of information systems research. The model 
was originally developed by DeLone and McLean (1992), considering the five 
above-mentioned dimensions to predict IS success: system quality, information 
quality, use, user satisfaction, and organizational impact. In the previous 
literature, a diversity of factors and contingencies related to educational 
innovation undertakings have been highlighted (Cuku8ié, Alfirevié, Granic, & 
Garaéa, 2010; Lofstr6m and Nevgi, 2007). Research is needed to develop 
models that help to comprehend e-learning education success, which is linked to 
continuance commitment. 
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ANTECEDENTS OF E-LEARNING COMMITMENT IN 
HIGHER EDUCATION 


Instructor quality 

E-learning researchers have reported that when learners are presented with a 
new learning system, their decision to use it is affected by several factors. Due to 
its importance, one of the most well-recognized factors is instructor quality 
(Petruzzellis, D'Uggento, & Romanazzi, 2006). Instructor quality is a variable that 
has been studied in the ISSM framework. Cheng, Wang, Moormann, Olaniran, & 
Chen (2012) included instructor quality in their study that examined the quality 
factors that can affect student intention to use e-learning systems. They 
concluded that information, service, system and instructor quality were key 
drivers of student perceptions of e-learning acceptance. Kim, Trimi, Park, & Rhee 
(2012) found that instructional quality combined with system and information 
quality positively influenced user satisfaction. In recent research, Farr-Wharton, 
Charles, Keast, Woolcott, & Chamberlain (2018) have found that the lecturer- 
student relationship positively reinforced their engagement with the university and 
was essential to encourage students to continue their formal education within the 
institution. Similarly, Bigné, Badenes, Ruiz, & Andreu (2018) captured the 
importance of teacher skills to enhance student engagement. 

The instructor is a multidimensional construct shaped by three variables: 
instructor assurance, instructor empathy, and instructor responsiveness (Cao, 
Zhang, & Seydel, 2005; Udo, et al., 2011). According to Cao, et al. (2005), 
instructor assurance discloses both the knowledge and the skills of the teacher 
that inspire confidence as professionals; empathy includes concern and 
individualized attention that the teacher can offer the student; and, instructor 
responsiveness reflects a willingness to help students and to provide a prompt 
service. These three dimensions were selected from the original constructs, due 
to their proven significance in the e-learning context (Udo, et al., 2011). All three 
characteristics influence how e-learners perceived teacher quality in online 
education (Liaw, 2008). 

Previous research (Stodnick and Rogers, 2008; Udo, et al., 2011) has 
suggested that the perceptions of system and teaching quality among students 
affect their satisfaction (Parahoo, et al., 2016) and continuance intention toward 
an online service (Kang and Lee, 2010). From the perspective of university 
teachers, their perceived performance as lecturers proves essential for their 
planned continuance in the teaching profession (Gonzalez, Conde, Diaz, Garcia, 
& Ricoy, 2018), and in their commitment toward the use of an IS (Ashrafzadeh 
and Sayadian, 2015). According to the expectation-confirmation theory (Oliver, 
1999), the perception of service quality (i.e. e-learning) motivates continuance 
commitment among users, which is essential to achieve the long-term viability of 
an IS (Bhattacherjee, 2001), so that it may be considered successful; not only is 
a one-time acceptance or a one-time use of the system essential, but the 
development of commitment toward personal continuance (Kim and Malhotra, 
2005). Therefore, due to the effort that must be made to develop an information 
system such as an LMS, it is essential to retain existing users of that technology, 
or as Luo, Zhang, & Qi (2017) explained, to create stickiness to the learning 
system. Accordingly: 
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H1. The quality of the instructor will influence continuance commitment toward 
the e-learning system among students (H1a) and teachers (H1b) in a positive 
manner. 


E-Learning system quality 

As previously mentioned, the ISSM is one among a few of the most accepted 
models that identify the essential characteristics of an IS and that investigate how 
those characteristics can influence its use. When researching the e-learning 
context, the contemplation of IS quality as a complex factor is inevitable, due to 
the characteristics of the IS, which is specifically designed to create an online 
learning space for the most effective means of information exchange (Cuku8ic, 
et al., 2010; L6fstr6m and Nevgi, 2007). For that reason, the dimension of system 
quality is analyzed on the LMS by the following variables: educational quality, 
information quality, technical system quality, and service quality (Mohammadi, 
2015). 

Educational quality can be defined in this context as the ability of the LMS to 
provide a proper learning environment for students committed to collaborative 
learning (Hassanzadeh, Kanaani, & Elahi, 2012; Kim, Lee, & Rha, 2017). This 
aspect displays how the interactive capacity of the LMS influences the perception 
of e-learning as a useful learning tool (Wang and Chiu, 2011). The information 
quality dimension shows the usefulness of the information that both students and 
teachers generate on the LMS (Mohammadi, 2015) regarding information 
completeness, relevance, and trendiness. In an e-learning system, information 
quality is extremely important to the student, as the informational groundwork for 
learning is contained in the system (Aparicio, Bacao, & Oliveira, 2017). The 
variable service quality refers to the support the users receive when they access 
the e-learning system and how the technical infrastructure may face a problem 
(Wang and Wang, 2009). In this case, it is important that technical support staff 
provide the right attention and a proper service to address user difficulties 
(Headar, Elaref, & Yacout, 2013; Wang and Chiu, 2011). Lastly, technical system 
quality, dependent on the accuracy and the efficiency of the LMS, is defined as 
its functional success at reproducing and delivering the information (DeLone and 
McLean, 1992). 

The e-learning system use may be encouraged, if the contents are easy to 
access and the platform is well structured (Petter, DeLone, & McLean, 2008). 
Moreover, system quality has been shown to have the strongest positive impact 
on participant intention to reuse an e-learning management system 
(Almarashdeh, 2016; Hassanzadeh, et al., 2012; Mohammadi, 2015). This initial 
acceptance and intention to use an IS are the predecessors of the post- 
acceptance phase of the implementation of an IS (Bhattacherjee, 2001), where 
the use of the LMS continues over time fostering continuance commitment among 
its users. Along these lines, recent research on the continuance use of online 
learning environments suggests that information quality, system quality, and 
service quality positively affect the continuance commitment of students (Daghan 
and Akkoyunlu, 2016) and that information and system quality affect the 
continuance commitment of teachers (Zheng, Zhao, & Stylianou, 2013). 
Therefore: 


H2. The quality of the e-learning system will influence continuance commitment 
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toward the e-learning system among students (H2a) and teachers (H2b) in a 
positive manner. 


E-Learning organizational impact and institutional support 

The implementation of a high-quality information system in the context of 
higher education promotes global improvements in the institution (Kimiloglu, 
Ozturan, & Kutlu, 2017). Along those lines, McGill, Klobas, & Renzi (2014) 
suggested that when a user perceives that an e-learning initiative has a positive 
impact on the organization, it follows that its usage will be ‘promoted’ within the 
organization. In the e-learning context, the organizational impact is defined by a 
measured improvement in the global institutional results that can be attributed to 
the LMS (Gable, Sedera, & Chan, 2008), with regard to competitiveness, service 
quality, and communication between users (Ashrafzadeh and Sayadian, 2015). 

Gorla, Somers, & Wong (2010) found a clear linkage between system quality 
and organizational impact, confirming increasing organizational dependency on 
quality information systems and the need for evidence on the perception of quality 
systems and their improvement in an educational context. Alkhalaf, Drew, 
AlGhamdi, & Alfarraj (2012) found that LMS system quality has an organizational 
impact on the institutions that not only helps teachers to improve their 
performance, but also the organizational services that are provided to all users. 
Student perceptions might also affect e-learning system quality, in view of the net 
benefits of those systems relating to competitiveness, easier access to education 
and cost savings - also associated with the organizational impact of a higher 
educational institution. Consequently: 


H3. The quality of the e-learning system will influence the perceived 
organizational impact of the e-learning system among students (H3a) and 
teachers (H3b) in a positive manner. 


Complementing that idea, the previous literature has also identified another 
key variable to be integrated as an antecedent to organizational impact: 
institutional support. In the e-learning context, institutional support is defined as 
the support that e-learning initiatives receive from the organization. It implies 
financial support and institutional recognition of the time and experience that is 
necessary to develop innovative initiatives and to maintain them (McGill, et al., 
2014). Nijman and Gelissen (2011) suggested that institutional support 
represents assistance to users of IS that can be in terms of instrumental 
guidance, as much as information, emotional support, and appraisal. Therefore, 
recognition of the effort associated with making an e-learning system work can 
be added to the provision of resources and solutions for the active use of this 
initiative. A variable that has been proven to be one of the critical factors that 
ensures the initial adoption (Cheng, et al., 2012) of any e-learning system used 
in higher education institutions, for both teachers and students, and its 
continuance (Gunn, 2010; McGill, et al., 2014). Hence: 


H4. Institutional support will influence the perceived organizational impact of the 
e-learning system in the higher educational institution among both students (H4a) 
and teachers (H4a) in a positive manner. 
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As previously mentioned, organizational impact is the perception of the general 
improvement that an IS has stimulated in the organization (Gable, et al., 2008). 
Previous research (Alkhalaf, et al., 2012) has suggested that the perception of 
benefits for the organization enhances continuance commitment with the e- 
learning program among teachers and students, as they perceive that their 
contribution adds to the general value of the organization. Aparicio, et al. (2017) 
stated that continuance commitment must develop to assure the success of an 
e-learning system over time, a development that takes place if the benefits of the 
e-learning system are perceived within the organization. Thus, organizational 
impact, whether technological or pedagogical, can influence the continuance 
commitment of users toward the e-learning systems (Krotov, 2015). Therefore: 


H5. Perceived organizational impact will influence continuance commitment 
toward the e-learning system among students (H5a) and teachers (H5b) in a 
positive manner. 


The whole set of hypotheses are presented in Figure 1. 


Figure 1. Research model. 
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METHODOLOGY AND RESULTS 


Information was gathered using an electronic questionnaire with the help of an 
online platform, ensuring the anonymity of the respondents (Mansor, 2012). The 
questionnaire was distributed among teachers and students of online courses 
(degrees and masters) of two Spanish higher education institutions. A non- 
random sampling process in two stages was employed to collect the information. 
First, all the online teachers from two Universities (the main learning system is 
offline in those universities, but online teaching is being implemented and 
increasing) were selected to conduct the survey, and second, those who 


Journal of Management and Business Education 23), 231-249 239 


answered the questionnaire were also asked to contact their online students to 
invite them to participate in the study. 

270 valid questionnaires were collected (124 from teachers and 146 from 
students). The response rates were higher than 80%. As for the teacher sample, 
56% are male and 61% are between 44 and 55 years old, which is very similar to 
the online teachers’ national profile (most of them are male and are between 40 
and 59 years old; Ministerio de Ciencia, Innovacion y Universidades, 2018). As 
for the students sample, 55% are female and 50% are between 23 and 38 years 
old, which is similar to the online students’ national profile, with a more female 
students and of that age interval (Ministerio de Ciencia, Innovacién y 
Universidades, 2017). 

Scales taken from the previous literature were used to design the survey and 
to ensure the content validity of the measures (see Table 1 and 2 for details). The 
questionnaire design was distributed into five blocks and 5-point Likert scales 
were employed (from 1 = ‘strongly disagree’ to 5 = ‘strongly agree’). The first 
block refers to instructor quality, a higher-order construct (Kim, et al., 2012; Udo, 
et al., 2011) that consists of instructor assurance, instructor empathy and 
instructor responsiveness, adapted from Udo, et al. (2011). System quality was 
also measured as a higher-order construct and represents the second block 
(Hassanzadeh, et al., 2012; Mohammadi, 2015). It consists of educational quality, 
service quality, technical system quality and information quality, adapted from 
Mohammadi (2015). The third block, institutional support was adapted from 
McGill, et al. (2014). The fourth block that refers to organizational impact was 
taken from Alkhalaf, et al. (2012). Finally, continuance commitment with the e- 
learning system was adapted from Kang and Lee (2010). 


Measurement model 

The Partial Least Squares (PLS) bootstrapping approach was used to analyze 
the data, employing the statistics software SmartPLS 3.0. (Gudergan, Ringle, 
Wende, & Will, 2008). This method is useful to test the measurement validity of 
the reflective (i.e., continuance commitment) and formative constructs (i.e., 
instructors’ quality, system quality, institutional support, and organizational 
impact), and is less affected by a small sample size (Hair et al., 2016). 

According to Hair, et al. (2016), testing a measurement model that includes a 
higher-order construct implies that a two-stage approach should be followed to 
detect problems of multicollinearity. Table 1 shows the weights and VIF and 
tolerance values of the items. Following the same recommendations (Hair, et al., 
2016), the weights of an item are not considered significant; the loadings of the 
items were checked and it was confirmed that they had values above 0.5 and that 
they are significant. In turn, any multicollinearity of the formative scales was 
checked with two tests to establish the items with a variance inflation factor (VIF) 
below 5; and a tolerance index (TI), with values above 0.10 (Hair, et al., 2016). 
All the items with values that were not within the above-mentioned thresholds 
were removed from the analysis, as suggested in the literature (Hair, et al., 2016). 
Therefore, in keeping with the recommendations (Hair, et al., 2016), the 
previously validated first-order constructs (instructor quality and system quality) 
could then be incorporated into the higher-order measurement model. 
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Table 1. First-order measurement model. 


240 





Items Weight t-value VIF Tl 
Instructor quality 

Instructor assurance 

The instructor is fair and impartial in grading. 0.761 1.866 1.135 0.684 
The instructor answers all the questions thoroughly.a - 7 _ 7 

The instructor has an expert understanding of the material. 0.437 0.974 1.135 0.687 
Instructor empathy 

The instructor is genuinely concerned about the students. 0.323 1.771 2468 0.278 
The instructor understands the individual needs of students. 0.452 2.459 2.387 0.343 
The instructor has the students’ best long-term interests in 0.138 0.731 3.027 0.293 
mind. 
The instructor encourages and motivates students to do 0.467 2.249 3.100 0.236 
their best. 
Instructor responsiveness 

The instructor quickly and efficiently responds to students’ 0.428 2.358 1.927 0.293 
needs. 
The instructor always welcomes students’ questions and 0.655 3.972 1.927 0.322 
comments. 
System quality 

Educational quality 

E-learning provides incentives to the student. 0.129 1.891 1.346 0.683 
E-learning provides collaborative learning. 0.249 3.384 1.589 0.473 
E-learning provides required facilities such as chats anda . : 7 
forum.a 

E-learning provides the possibility of communicating with 0.244 3.470 1.369 0.597 
other students. 
E-learning provides the possibility of learning evaluation.a = __ 7 7 2 
E-learning provides a good learning style. 0.622 8.903 1.634 0.331 
Information quality 

E-learning provides information that is relevant to the 0.410 4.068 2.114 0.339 
students’ needs. 
E-learning provides complete information. 0.023 0.222 1.929 0.381 
E-learning provides the information the students’ wants. 0.311 2156 3.609 0.234 
E-learning provides organized content and information. 0.126 1.474 1.680 0.488 
E-learning provides up to date content and information.a 7 P 7 7 
E-learning provides required content and information. 0.332 2618 3.509 0.219 
Service quality 

E-learning provides proper online assistance and 0.504 6.535 1.515 0.352 
explanation. 
E-learning department staff respond in a cooperative 0.332 3.710 1.327 0.496 
manner. 

E-learning provides the opportunity of reflecting views. 0.404 4.756 1.436 0.520 
E-learning provides is a good management tool for the 7 : : 7 
courses.a 

Technical system quality 

The e-learning platform is easy to use 0.065 0.367 1.926 0.463 
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The e-learning platform optimizes response time. 0.135 0.756 2.025 0.455 
The e-learning platform is user friendly. 0.038 0.188 2.358 0.392 


The e-learning platform offers interactive features between 0.362 2.314 1.576 0.581 
users and the system. ‘ ‘ ; : 


The e-learning platform possesses a structured design. 0.250 1.509 1.709 0.508 
The e-learning platform has flexible features.a : . : . 

The e-learning platform has attractive features. 0.065 0.310 2.319 0.385 
The e-learning platform is reliable. 0.334 1.656 3.472 0.263 
The e-learning platform is secure. 0.198 1.062 2690 0.320 





4 Deleted items. 


In the higher-order measurement model, instructor quality and system quality 
are formative higher-order constructs as are _ institutional support and 
organizational impact. Continuance commitment toward the e-learning system is 
considered a reflective construct (Table 2). Multicollinearity was ruled out in the 
formative constructs, as VIF values below 5 and IT values above 0.10 (Petter, 
Straub, & Rai, 2007) were corroborated. The convergent validity of the reflective 
scales was confirmed, because the values of their average variance extracted 
(AVE) at all times showed values higher than 0.5; their composite reliability (CR) 
had values in excess of 0.6; and, the Cronbach Alpha (a) values were higher than 
0.7. The evaluation of discriminant validity is not required for formative constructs 
in the PLS path model (Hair, et al., 2016). 


Table 2. Higher-order measurement model. 





Dimensions Weight t-value VIF Tolerance 
Instructor quality 

Instructor assurance 0.605 3.298 2.222 0.733 
Instructor empathy 0.498 2.436 2.426 0.231 
Instructor responsiveness -0.094 0.746 1.185 0.268 
System quality 

Educational quality 0.359 4.591 2.042 0.292 
Information quality 0.319 4.146 2.181 0.329 
Service quality 0.428 5.291 2.370 0.295 
Technical system quality 0.072 1.078 1.206 0.624 
Items Weight t-value VIF Tolerance 





Institutional support 

The University supports the continuance of this 0.051 0.482 2.979 0.304 
innovation. 

The University supports the initiatives of 0.234 2.381 2.623 0.343 
innovation in e-learning. 

There is financial support for the development of 0.239 2.904 2.317 0.388 
this innovation. 

There is technical support for the development of -0.002 0.021 2.503 0.314 
this innovation. 


There are human resources for the ongoing 0.150 1.633 2.272 0.369 
development of the innovation. 
This innovation represents a competitive 0.567 7.184 1.626 0.392 


advantage for the University. 
Organizational impact 


The e-learning system helps to improve my 0.080 1.348 1.761 0.429 
performance. 
The e-learning system helps the organization 0.013 0.229 1.619 0.541 


save on delivery costs. 
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The e-learning system helps me think through 0.120 1.678 2.389 0.350 
problems. 

The e-learning system helps the organization 0.268 3.719 2.551 0.336 
enhance its competitiveness. 

The e-learning system helps the organizationto 0.269 3.696 3.011 0.281 
respond quicker to change. 

The e-learning system helps to deliver better 0.041 0.567 2.435 0.368 
teaching performance to the students. 

The e-learning system facilitates communication 0.325 5.007 2.235 0.371 
between users. 

The e-learning system helps the organization to 0.120 1.782 1.870 0.442 
achieve its goals. 





Items Loading t-value 
Continuance commitment (a=0.830, CR=0.900, AVE=0.751) 

| would like to continue being an online teacher. 0.925 71.310 
My intentions are to continue being an online 0.915 70.291 
teacher. 

| prefer online teaching rather than offline 0.749 15.407 
teaching. 





Structural multigroup analysis 

Having validated the measurement model, a multigroup analysis was 
performed. A multigroup model was estimated addressing the different 
perspectives for two differentiated users: students and teachers. The two groups 
were similar in size, as 54.1% of the respondents were students and the 45.9% 
were teachers. The Welch-Satterthwaite MGA test showed that there was no 
significant difference in the strength of the effect studied for both groups (students 
and teachers) (Table 3). Hence, the model was considered suitable to evaluate 
the antecedents of continuance commitment with the e-learning system for both 
user groups. The standardized root mean square residual (SGRMR) was 0.066, 
suggesting that the fit of the model was acceptable (Haenlein and Kaplan, 2004). 


Table 3. PLS multi-group analysis and Welch-Satterthwait Test. 








Siudenis Teachers Welch-Satierthwait 

(Hypothesis a) n= 146 (Hypothesis b) n = 124 Test 
Path B (Students a) t-value £(Teachersb)  t-value Difference p-value 
H1. Instructor quality 0.023 0.269 -0.008 0.077 0.032 0.819 
>Continuance 
commitment 
H2. System quality 0.172 1.618 0.238 1.668 0.066 0.710 
>Continuance 
commitment 
H3. System quality 0.521*** 6.405 0.521*** 6.969 0.000 0.998 
> Organizational impact 
H4. Institutional support 0.480*** 5.340 0.394*** 4.924 0.086 0.472 
> Organizational impact 
H5. Organizational 0.558*** 5.425 0.418*** 3.485 0.140 0.374 
impact >Continuance 
commitment 





Note=8: path coefficient;***p<0.001 
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The results showed that instructor quality had no influence on continuance 
commitment toward the e-learning system, neither among students nor among 
teachers. Hypotheses H1 (a-b) were therefore not supported. Likewise, 
hypotheses H2 (a-b) were rejected, as the variable system quality showed no 
significant effects on the continuance commitment of both teachers and students. 
However, system quality showed a significant and positive effect on 
organizational impact, thereby supporting hypotheses H3 (a-b). The results also 
showed that institutional support positively influenced organizational impact, 
which supports H4 (a-b) both for students and for teachers. Finally, organizational 
impact positively affected continuance commitment among students and 
teachers, lending support to H5 (a-b). These results lead the research toward a 
deeper comprehension of continuance commitment toward e-learning systems in 
higher education and its initiation. The robustness model considers two important 
user groups that further our understanding of commitment toward educational 
initiatives, such as e-learning. Figure 2 graphically summarizes these results. 


Figure 2. Results of the structural multigroup analysis. 


Instructor quality =} ----------------------- = 
System quality a 


Institutional suport 







Continuance 
commitment 


R? = 0.378 


a- 0.558 
b- 0.418 


Organizational impact 


a > No significant path 
———> Significant path 





R? = 0.717 





b- 0.394 


DISCUSSION AND CONCLUSION 


The contributions of this study to the literature cover several aspects. First, our 
approach supports the ISSM model developed by DeLone and McLean (1992) 
and updated by Gable, et al. (2008); it is a useful framework to analyze the e- 
learning characteristics of relevant stakeholders, in this case teachers and 
students, in a post-adoption scenario (Aparicio, et al., 2017; Gunn, 2010; McGill, 
et al., 2014). The proposed hypotheses suggest a generalization of the impact of 
e-learning system quality and institutional support within the organization, and the 
positive effect of the organizational impact on continuance commitment from both 
user group perspectives. The evidence reinforces the conceptualization of e- 
learning as a multidimensional system where each dimension must be 
individually evaluated by all participants (Gable, et al., 2008). 

Our results have suggested that the perception of the e-learning system is a 
decisive factor in promoting a positive impact within higher education institutions 
and in enhancing continuance commitment. This finding is hardly surprising from 
the perspective of the teachers, because they usually depend on the success of 
the e-learning system to reduce the uncertainty that surrounds their position as 
online teachers (Ortlieb and Weiss, 2018). Organizational improvements 
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promoted through the e-learning system would also allow higher education 
institutions to save costs, to improve academic performance, and to sharpen their 
competitiveness. These factors indicate the success of these innovative teaching 
initiatives (Aparicio, et al., 2017) and the probability of an e-learning program 
continuing over time (McGill, et al., 2014). From the students’ perspective, the 
perception of e-learning success could be related to the global organizational 
image, which is essential for higher education institutions that usually strive to 
create a positive image among their students (Polat, 2011). In fact, University 
image has proven itself to be a key factor for students when enrolling on a 
program and deciding to continue at university (Sung and Yang, 2008). 

System quality is the factor that has the highest impact on the perceived 
organizational impact of e-learning systems. This result points to the importance 
of assessing the quality of the whole e-learning system at higher education 
institutions (Bhattacherjee, 2001). In addition, the institutional support of e- 
learning initiatives impacts positively on the organization, which highlights the 
importance of developing innovative initiatives that meet the needs of teachers 
and students including financial and technological support and assistance and 
recognition. These results are consistent with other studies, given the fact that 
system quality is an important factor in assessing the perceived benefits of e- 
learning system for students (Mohammadi, 2015) and teachers (Almarashdeh, 
2016). The perception that the institution is involved in the program and supports 
e-learning initiatives will encourage its participants to develop their continuance 
commitment. This evidence is consistent with the concerns recognized in the 
previous literature (Gunn, 2010; McGill, et al., 2014), which has pointed out that 
Ongoing institutional support is essential to continue an e-learning initiative over 
time. The financial and technical support provided by the institution, as well as 
the capability to involve human resources to maintain this educational initiative, 
has a direct impact on the organization, which, in turn, has a positive effect on 
continuance commitment toward the use of an LMS among students and 
teachers. 

Surprisingly, some of our results proved contradictory with previous research 
findings (Udo, et al., 2011) (i.e. the non-significant direct effect of instructor quality 
and system quality on continuance commitment), one possible explanation might 
be the transcendental change in the educational paradigm, especially reflected 
in e-learning education. Teachers have to manage the design of their courses 
and are in charge of monitoring the learning process, but they play the role of 
facilitators rather than authorities (Duart and Mengual-Andrés, 2015). These 
results reinforce the need for a new conceptualization of the figure of the teacher 
in the e-learning context (McConnell, 2018), as neither students nor teachers 
found that their continuance commitment was significantly influenced by the 
perceived quality of the instructor. Moreover, system quality is not a direct driver 
of continuance commitment, which could be explained by the multidimensional 
nature of e-learning systems. Recent research has pointed to the possibility that 
factors related to individual values, such as personal grit (Aparicio, et al., 2017) 
and personal autonomy (Henri, et al., 2018), are more important than system 
quality in the post-adoption phase of an e-learning system. 

This research implies some limitations and opportunities. First, our results 
suggest that instructor quality measurement should be reviewed and 
operationalized, so that it is adapted to the new educational paradigms (Cheng, 
et al., 2012; Kim, et al., 2012; Udo, et al., 2011). Second, future research should 
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consider individual values as essential constructs of continuance commitment 
among users. Third, this study undoubtedly highlights the need to improve our 
knowledge of how the positive organizational impacts of both e-learning and 
continuance commitment could influence the image and the reputation of higher 
education institutions; both factors should be contemplated in future research on 
e-learning systems at institutions of higher education. Fourth, other users (i.e. 
managers and administrative staff) must also be given due consideration. 
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